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DEGENERACY  IN  LINEAR  COMPLEMENTARITY  PROBLEMS 


by 

Yow-Yieh  Chang 

Department  of  Operations  Research 
Stanford  University 


ABSTRACT 


This  study  centers  on  the  circling  phenomenon  associated  with 


degeneracy  in  linear  complementarity  problems  and  presents  an  easily  imple¬ 


mented  technique  for  resolving  it.  With  certain  exceptions,  the  device  is 
to  use  the  least-index  for  selecting  the  variable  to  leave  the  basic  set. 


The  results  of  this  report  pertain  only  to  linear  complementarity 
problems  involving  P-matrices  or  positive  semi-definite  matrices.  With 
this  restriction,  it  is  shown  that  inclusion  of  the  least-index  pivot 
selection  rule  Insures  finiteness  for  the  principal  pivoting  method  of 
Dantzlg  and  Cottle,  Lemke's  algorithm, and  Cottle's  parametric  principal 
pivoting  method.  It  is  shown  that  for  circling  to  occur  in  the  principal 
pivoting  method,  the  matrix  must  have  order  at  least  four,  and  for  Lemke's 
algorithm  it  must  be  at  least  three.  Examples  are  given  showing  that  these 
bounds  are  sharp.  Finally,  Murty's  version  of  Bard's  method  is  extended 


PART  I 


LEAST-INDEX  RESOLUTION  OF  DEGENERACY  IN 
THE  DANTZ I G- COTTLE  PRINCIPAL  PIVOTING  METHOD 


1.  Introduction 

Given  a  matrix  M  €  ®n  n  and  a  vector  q  €  Rn,  the  linear  comple¬ 
mentarity  problem  (q,M)  is  that  of  finding  a  solution  to  the  system 

(1)  w  =  q  +  Mz 

(2)  w  >  0,  z  >  0 

(3)  wTz  *  0 

(or  showing  that  no  solution  exists).  A  pair  (w,z)  of  n-vectors  is  a 
comp lemen t ary  solution  of  (1)  provided 

z.w,  *  0,  z_w~  -  0,  ...  ,  z  w  «  0  . 
ii  t  t  •  n  n 


A  basic  set  of  variables  consists  of  any  ordered  set  of  n  variables  w^ 
and  Zj  such  that  their  coefficient  matrix  in  (1),  called  a  basis,  is  non¬ 
singular.  A  complementary  basic  set  of  variables  is  one  in  which  exactly 
one  variable  of  each  complementary  pair  (w^.z^)  is  basic.  Finally,  a  basic 
solution  is  the  one  found  by  solving  for  the  value  of  a  given  set  of  basic 
variables  when  the  nonbasic  variables  are  set  equal  to  zero. 

A  basic  solution  of  the  equation  v'l)  is  said  to  be  degenerate  if  at 
least  one  of  the  basic  variables  equals  zero.  As  in  slmplicial  methods  for 
linear  and  quadratic  programming,  degeneracy  also  causes  difficulties  In 
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simplicial  methods  for  the  linear  complementarity  problem  (LCP) .  More  pre¬ 
cisely,  degeneracy  can  lead  to  the  phenomenon  known  as  circling:  a  sequence 
of  bases  which  (after  finitely  many  steps)  repeats  itself.  Degeneracy  per 
se  is  not  the  problem;  but  when  it  is  present,  circling  is  a  possibility 
and  must  be  avoided  if  the  simplicial  methods  are  to  work  and  be  finite. 

The  "degeneracy  problem"  refers  to  the  difficulties  associated  with  circling. 

Except  for  Murty's  scheme  [15],  the  only  theoretical  techniques 
available  for  handling  the  degeneracy  problem  in  the  LCP  have  been  lexico¬ 
graphic  (perturbation)  pivot  selection  rules  and  random  choice  rules.  We 
shall  not  review  them  here;  they  can  be  found  in  the  work  of  Zoutendijk  [20, 
pp.  80-90],  Graves  [10],  Eaves  [8]  and  Lemke  [12]. 

In  this  part,  we  present  a  natural  least-index  pivot  selection  rule 
which,  when  imposed  on  the  Dantzig-Cottle  principal  pivoting  method  [2],  [5], 
[7]  for  the  LCP,  will  ensure  its  finiteness.  This  rule  is  also  very  easy 
to  implement  and  does  not  require  extra  storage  or  computation. 

2.  The  PPM  with  P-matrices 

The  Dantzig-Cottle  principal  pivoting  method  (PPM)  was  devised  to 
process  (q,M)  where  M  is  either  a  P-matrix  or  a  positive  semi-definite 
matrix.  The  matrix  M  is  called  a  P-matrix  if  the  determinants  of  all  its 
principal  submatrices  are  positive.  We  consider  P-matrices  in  this  section 
and  leave  the  case  of  positive  semi-definite  matrices  to  Section  3. 

In  applying  the  least-index  pivot  selection  rule  to  resolve  the 
degeneracy  problem  in  the  PPM,  we  rely  on  a  paper  of  Murty  [15]  which  also 
considers  a  least-index  rule  in  the  framework  of  a  Bard-type  algorithm  for 
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the  LCP  with  P-matrices.  For  the  references  on  the  Bard-type  algorithm, 
see  Bard  [1,  pp.  146-151],  Stickney  and  Watson  [18],  and  Zoutendijk  [20, 
pp.  80-90]. 


2.1.  Murty's  scheme  for  (q,M)  where  M  is  a  P-matrlx 

It  is  well-known  that  when  M  is  a  P-matrix,  (q,M)  has  a  unique 
solution  for  every  q  [16],  [17].  Using  this  fact,  thirty  [15]  proposed 
the  following  finite  scheme: 


Murty'  scheme. 

Step  0.  Set  h  ■  0.  Begin  with  the  system  w*1  *  q*1  +  t}1  z1  where 
0  0  0  0 

w  =  q  +  M  z  is  the  given  system  w  ■  q  +  Mz. 

Step  1.  If  q*1  0,  stop.  [w^;z^]  =  [q^;01  is  the  solution.  Otherwise 


Step  2. 


Choose  k  =  min{l|q^  <  0}  and  pivot  on  m^,  i.e 
brought  into  the  basic  set  in  place  of  w£.  Set 
return  to  Step  1. 


is 


h  »  h+1  and 


Murty  proves  that  this  scheme  solves  (q,M).  We  emphasize  that 
the  finiteness  of  this  scheme  is  a  result  of  the  uniqueness  of  the  solution 
to  (q,M)  where  M  is  a  P-matrix.  It  is  also  interesting  to  note  that 
his  proof  can  be  applied  to  show  the  following: 

Proposition.  In  Murty's  scheme,  a  pivot  in  row  k  must  be  followed  by  a 
pivot  in  some  row  with  a  larger  index  before  another  pivot  in  row  k  can  occur. 
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2.2.  A  brief  review  of  the  principal  pivoting  method 

There  are  two  versions  of  the  PPM:  the  symmetric  and  the  asymmetric 
versions.  They  both  make  use  of  the  invariance  of  P-matrices  under  principal 
pivoting  [7],  [191. 

Consider  an  LCP  (q,M)  in  which  M  is  a  P-matrix.  In  the  follow¬ 
ing,  wh,  zh,  M*  and  q*1  represent  the  basic  vector,  the  non-basic  vector, 
the  matrix  and  the  constant  colunn  at  the  h-th  interation,  respectively. 


Symmetric  version  of  the  PPM  [2],  [4],  [5 ] ,  [7], 


Step  0.  Set  h 


Begin  with  the  system  w 


h  ,  Ji  h 
q  +  M  z 


where 


w 


q^  +  M^z®  denotes  the  given  system  w  =  q  +  Mz. 


V»  u  u  u 

Step  1.  If  q  ^  0»  stop.  [w*  ;z  ]  =  [q;0]  is  the  solution.  Otherwise 

choose  some  q*1  <  0.  Call  w*1  the  distinguished  variable  and 
s  s 

z^  the  driving  variable. 

Step  2.  Determine  the  blocking  variable  by  letting  6  be  the  largest  value 
of  the  driving  variable  z^  such  that 


h  h  .  h  h  /  . 
w  *  q  +  m  z  <0 
s  s  ss  s  — 


h  h 


11  .  II  II  v 

qi  +  miszs  ^  0  * 


if  qh  >  0  >  in) 
i  -  is 


Step  3.  If  0  •  -q^/nr  ,  i.e.,  z*1  is  blocked  by  w\  then  pivot  on  in'  . 

8  88  S  S  SS 

x  h  h 

Replace  h  by  h+1  and  return  to  Step  1.  If  -q  /mn  >  0 

s  ss 

■  -q_/nt  for  some  t  where  q^  >  0  >  m*  ,  i.e.  zh  is  blocked 

t  C8  t  —  tS  S 

by  w£,  then  pivot  on  m^.  Replace  h  by  h+1  and  return  to 
Step  2. 
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In  this  algorithm,  each  return  to  Step  1  marks  the  completion  of  a 


major  cycle.  Assuming  nondegeneracy,  Dantzlg  and  Cottle  [7]  showed  that 
during  a  major  cycle,  the  distinguished  variable  Increases  to  zero  in  a  finite 
number  of  steps.  However,  the  completion  of  a  major  cycle  reduces  the  number 
of  negative  basic  variables  by  at  least  one.  Therefore,  no  more  than  n 
major  cycles  are  required  to  obtain  a  solution  of  (q,M). 

The  asymmetric  version  is  the  same  as  the  symmetric  version  except 
that  in  Step  3,  if  the  distinguished  variable  is  not  blocking  and,  say, 
w£  is  blocking,  then  one  performs  the  pivot  on  m^g  and  returns  to  Step  2 
with  zg+1  “  z|?>  the  complement  of  the  exiting  basic  variable,  as  the  new 
driving  variable. 


NOTE:  In  the  following,  we  shall  use  the  notation 
that  a  pivot  on  m^  is  performed  thereby  making 


<  w 

ZJ 


^,Zj>  to  represent 
basic  in  place  of 


w 


i* 


The  two  versions  of  the  PPM  are  closely  related.  In  fact,  we  have 
the  following: 


Theorem  1.  Under  the  same  rule  to  break  ties  among  the  blocking  variables, 
the  symmetric  and  asymmetric  versions  of  a  major  cycle  generate  the  same 
sequence  of  exiting  basic  variables. 


Proof.  Without  loss  of  generality,  we  may  assume  that  z^  is  the  driving 
variable  at  the  start  of  a  major  cycle.  If  w^  blocks  z^,  there  is  nothing 
to  prove.  Hence  suppose  w^  blocks  z^  for  some  k  +  1.  Under  the  same 
rule  to  break  ties,  the  two  versions  have  the  same  exiting  variable  at  this 
step.  In  particular,  the  corresponding  variables  in  the  two  versions  have 
the  same  values  at  this  step. 
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In  the  symmetric  version,  we  perform  the  pivot  <w  z  >  after  which 

k’  k 

the  system  can  be  written  as 


(4) 


Mk  ^  1  1  S 

z,  - - +  -  w, - )  m.  ,z, 

k  “kk  \k  k  \k  j-1  ^  J 


j*k 


(5) 


-i '  (’i  -  ^  \) +  ^  ”k  +  ("ir  *j 

j*k 


for  all  1  ^  k. 


In  the  asynmetric  version,  we  perform  <wk>z1'>.  After  the  pivot 
becomes  the  new  driving  variable  and  the  system  becomes 


(6) 


%  ,  ,  n 

Ei  - - +  -  w.  -  -  I  m,  z 

1  \l  \l  k  \l  j-2  J 


(7) 


j2  ■  "n  + (■*  •  »n  s 

U»k 


for  all  i  j*  k. 


Now,  since  z^  and  z^  are  the  driving  variables  in  the  two 
versions,  respectively,  we  compare  m±1  -  (■lk\1)/^tk»  the  coefficient 
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of  z^  in  (5),  and  tn^  -  the  coefficient  of  z^  in  (7). 

We  can  rewrite 


mil\k  \k  (  mik\l\ 

"ik  '  \1  “  -\1  'mil  "  \k  / 


for  all  i  +  k  . 


Since  w^  blocked  z^  at  the  previous  step,  we  have  <  0.  Also 

>  0  since  M  is  a  P-matrix.  Therefore  m^  -  and 

-\l/mkk 

the  coefficient  of  z^  in  (4),  and  — m^^/mki >  the  coefficient  of  z^ 
in  (6),  are  both  positive.  Thus  the  two  driving  colunns  at  this  step  have 
the  same  sign  configuration.  Also  note  that  before  the  pivots  <w^,z^> 
and  <wk,Zj>,  the  corresponding  variables  in  the  two  versions  have  the  same 
values . 


-  (mijcmjci)/I\ic  are  same  sign  for  all  1  i>  k.  Clearly 


Now,  suppose  wt  is  exiting  in  the  symmetric  version  at  the  next 
step  and  suppose  blocking  occurs  when  z^  -  z^.  Then  by  (5), 


(8) 


Also  by  (4) , 


Let  us  consider  the  system  In  the  asymmetric  version  when 


-  =  Jk  \l- 

"k  ’  **  "  \k  \k  Zl  ’ 

and 

z2  -  z3 . vrwkizk+i* 

By  (7)  and  (8), 

(  qk  \  /  \k  \  - 

t  V  t  cl  \i  /  V  tk  cl  \i  /  k 


*  q 


t 


+ 


Jk 


) 


mtk\l\ 
\k  ' 


Z1 


and  clearly  z^  has  the  value  z^.  It  follows  that,  at  this  step,  wt 
is  also  a  blocking  variable  in  the  asymmetric  version.  Furthermore,  the 
basic  variables  in  the  two  versions  are  the  same  except  that  z^  is  basic 
in  the  symmetric  version  while  z^  is  basic  in  the  asymmetric  version. 
Therefore,  under  the  same  rule  to  break  ties,  w£  is  also  the  exiting  vari¬ 
able  in  the  asymmetric  version. 

The  pivoting  sequence  <w^,z^>,  <wt,z^>  of  the  asymmetric  version 
has  the  same  effect  as  the  pivoting  sequence  <wk,zk>,  In  the 

symmetric  version  of  the  corresponding  pivoting  sequence  is  < wjc •  zjc>  » 

<wt,zt>*  ^us»  the  second  pivot  in  each  version  can  be  regarded  as  the 
first  pivot  associated  with  the  corresponding  method  applied  to  the  principal 
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transform  of  (q,M)  obtained  by  the  principal  pivot  <Wjc,z^>.  Therefore 
the  argument  just  given  applies  and  the  two  versions  have  the  same  exiting 
basic  variable  at  the  following  step. 


Generally,  suppose  a  sequence  of  pivots  has  been  performed  in 
the  asymmetric  version  and  the  last  pivot  is  on  m^ ,  this  pivoting 
sequence  has  the  same  effect  as  a  block  pivot  on  some  principal  submatrix 
Mgg  followed  by  a  pivot  on  m^.  In  the  symmetric  version,  the  correspond¬ 
ing  pivoting  sequence  can  be  regarded  as  obtained  by  performing  a  block 
pivot  on  the  principal  submatrix  Mgg  followed  by  a  pivot  on  m^.  Thus, 
the  last  pivot  in  each  version  can  be  regarded  as  the  first  pivot  associated 
with  the  corresponding  method  applied  to  the  principal  transform  of  (q,M) 

obtained  by  a  block  pivot  on  the  principal  submatrix  M .  Therefore  by 

bb 

the  same  argument  as  before,  the  two  versions  have  the  same  exiting  basic 
variable  at  the  next  step.  □ 


Remark.  It  follows  from  Theorem  1  that  if  one  version  is  finite,  then  so 
Is  the  other.  Accordingly,  we  work  with  the  symmetric  version  only. 


2.3.  The  PPM  with  the  least-index  rule 

If  degeneracy  occurs,  the  PPM  may  lead  to  circling.  Some  circling 
examples  will  be  given  in  Section  4.  We  consider  here  a  least-index  rule 
which  when  imposed  in  the  PPM,  will  ensure  its  finiteness. 
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Least-index  rule. 


-O' 


In  applying  the  PPM  to  solve  (q,M)  break  ties  among  the  block¬ 
ing  variables  as  follows: 

(A)  If  the  distinguished  variable  is  blocking,  choose  it  as  the  exiting 
variable  (and  the  major  cycle  terminates). 

(B)  Otherwise,  choose  the  blocking  variable  with  the  smallest  index  as 
the  exiting  variable. 

In  the  following,  we  show  that  the  PPM  with  this  least-index  rule 
will  solve  the  problem  in  a  finite  number  of  steps.  To  do  so,  it  suffices 
to  show  that  each  major  cycle  is  finite.  We  shall  prove  this  by  first 
assuming  that  circling  occurs  in  a  major  cycle  and  then  deriving  a  contra¬ 
diction.  Without  loss  of  generality,  we  may  assume  that  w^  is  the  dis¬ 
tinguished  variable  in  this  major  cycle.  Let 

B  —  (  h .  ,  hn ,  ...  ,  h  } 

i.  Z  IQ 

hi  h^  h^  h^ 

where  hj+^  *  h^+1  for  j  *  l,2,...,m-l,  and  w  =  q  +  M  z  represents 

the  system  in  which  a  previous  basic  set  is  repeated  for  the  first  time. 

h  +1  h  +1  h  +1  h  +1 

h  is  a  positive  integer  such  that  the  system  w  “  q  +  M  z 

m  hl  hl  hl  hl  h 

has  the  same  basic  set  as  that  of  w  =  q  +  M  z  Note  that  w^  *  w^ 

and  z!1  -  z,  for  all  h  -  h, . h  .  In  the  following,  the  phrase  "during 

11  1  m 

circling"  will  mean  "during  the  pivoting  steps  h  ,  hj,  ...  ,  h^." 

Lemna  1.  If  circling  occurs,  then  the  value  of  the  driving  variable  z^ 
is  fixed  during  circling. 
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Proof.  Since  Zj  is  the  driving  variable,  it  is  nondecreasing  in  this 
major  cycle.  If  z^  is  not  fixed  during  circling,  then  it  attains  two 

—  m 

values  z^  <  z^.  There  are  only  finitely  many  basic  solutions,  each  of 

which  corresponds  to  a  unique  set  of  values  of  the  basic  variables.  Now 
h  —  s 

since  z^  increases  from  z^  to  z^,  we  can  not  return  to  a  previously 
encountered  basis,  a  contradiction,  a 

Lemma  2.  Assume  circling  occurs.  Let  K  *  (ilw^  becomes  nonbasic  during 
circling).  Then  during  circling  the  values  of  the  basic  variables  w^ 

are  at  their  lower  bounds  (zero)  for  all  i  €  K. 


Proof.  The  set  K  can  be  written  as  K  =  {k. ,  k„ . k  }  where 

1  l.  m 

k  is  the  index  of  the  variable  leaving  the  basic  set  at  step  h  . 

J  hl  i 

Since  w.  is  a  blocking  variable  at  the  first  step  of  circling,  it 

*1 

hi  h.  h 

follows  from  Lemma  1  that  w.  *=  0.  Therefore  after  the  pivot  <  w,  ,  z  >, 

1  kl  kl 

all  other  basic  variables  remain  fixed. 


Now  the  algorithm  tries  to  increase  z  again.  (Note  that 

h  h2 

z  »  z  -  z_.)  However,  Lemma  1  implies  that  it  can  not  be  Increased. 
h2  h 

Thus  w^  =  0.  Since  each  w^  is  involved  in  a  pivot  during  circling, 
the  argument  just  given  applies  and  the  proof  is  complete.  □ 


Lemma  3.  If  circling  occurs,  then  at  each  step  of  circling  mj^  <  0 
for  some  k  €  K. 

Proof .  By  the  definition  of  the  set  K,  at  each  setp  of  circling,  w^ 
becomes  nonbasic  for  some  k  i  K.  This  implies  that  w^  is  a  blocking 
variable  at  this  step.  However,  since  z^  is  the  driving  variable,  this 
can  happen  only  when  <0.  □ 
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Now  we  come  to  our  result. 


Theorem  2.  In  the  PPM  with  the  least-index  rule  applied  to  (q,M)  where 
M  is  a  P-matrix,  every  major  cycle  consists  of  a  finite  number  of  pivots. 

Proof.  Suppose  circling  occurs  in  a  major  cycle  in  which  zj  is  the 
driving  variable.  Lemmas  2  and  3  impl,  st,  during  circling,  the  algorithm 
looks  for  the  index  j  where 

j  =  min{i|w^  =  0  and  m^  <  0} 

and  then  performs  <w'?,  z^>.  Therefore,  during  circling,  the  PPM  with  the 

J  J  u  hi 

,Mkk>  where  K 

is  as  defined  in  Lemma  2.  However,  Murty's  scheme  is  finite.  This  implies 
that  after  a  finite  number  of  steps  M^  2  0  for  some  h,  in  contradiction 
to  Lemma  3.  □ 

Corollary.  The  PPM  with  the  least-index  rule  applied  to  the  LCP  (q,M), 
where  M  is  a  P-matrix,  will  find  the  solution  in  a  finite  number  of 
steps. 

Proof.  The  completion  of  each  major  cycle  reduces  the  number  of  negative 
basic  variables  by  at  least  one,  and  by  Theorem  2  each  major  cycle  is 
finite.  □ 


1 

least  index  rule  is  merely  Murty's  scheme  on  the  LCP  (M^ 
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Remark.  If  an  algorithm  just  changes  the  basis  and  leaves  the  values  of 
all  variables  fixed  during  some  consecutive  steps,  we  say  that  stalling 
occurs  in  these  steps.  The  proof  of  Theorem  2  and  the  Proposition  in 
Section  2.1  show  that  during  stalling  a  pivot  in  row  k  must  be  followed 
by  a  pivot  in  some  row  with  a  larger  index  before  another  pivot  in  row  k 
can  occur. 


3.  The  PPM  with  positive  semi-definite  matrices 
3.1.  Statement  of  the  method 

When  the  system  w-q+Mz,  w  >  0,  z  >  0,  has  a  solution,  we 

say  that  (q,M)  is  feasible,  otherwise  it  is  infeasible.  It  is  well-known 

that  when  M  is  positive  semi-definite,  (q,M)  has  a  solution  whenever  it 

is  feasible.  With  some  modifications,  the  PPM  as  stated  in  Section  2.2  can 

be  applied  to  find  a  solution  of  (q,M)  or  to  detect  its  infeasibility. 

Similar  to  the  case  of  P-matrices,  all  variables  whose  current  value  is 

non-negative  are  bounded  below  by  zero.  Moreover,  those  variables  whose 

current  value  is  negative  will  be  bounded  below  by  a  fixed  negative  number 

8  (the  same  one  for  all  such  variables).  For  example,  6  can  be  chosen 

as  any  nej;  *^ve  number  such  that  0  <  min{q  }  if  q  £  0.  Accordingly,  we 

i  1 

modify  our  notion  of  a  basic  solution  to  allow  nonbaslc  variables  to  assume 
the  value  0  or  8 .  The  value  8  arises  from  the  situation  where  a  basic 
variable  decreases  to  8 ,  thereby  blocking  the  driving  variable.  The 
method  will  make  that  blocking  variable  nonbaslc  at  value  8 .  This  device 
is  necessary.  For  example,  if 


I 

4 
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-1 


0  1 


M  - 


-1  1 


and  is  distinguished,  then  z is  unblocked.  Yet  the  problem  has  a 

solution.  We  shall  also  change  the  definition  of  a  nondegenerate  solution 
to  be  one  in  which  at  most  n  of  the  2n  variables  equal  0  or  8 . 


Notation. 

As  before,  the  superscript  h  denotes  the  iteration  number.  Since 

the  nonbasic  variables  may  attain  the  negative  value  8 ,  we  use 

wi^Zl’'**’  2n^  to  <*enote  the  value  of  the  basic  variable  w^  when  the 

nonbasic  variables  z'?,...,  zh  have  the  values  z^1,...,  zh. 

n  In 

Symmetric  version  of  the  method  [21.  [4],  [5 1 .  f 7 1 
(Note:  Nondegeneracy  is  assumed  here.) 

Step  0.  Set  h  -  0.  Begin  with  the  system  wh  «  qh  +  j^z1*  and  the 
solution  [wh;  zh]  •  [qh;  0],  where  w°  -  q°  +  M°z°  denotes 
the  given  system  w  «  q  +  Mz. 

Step  1.  If  qh  >  0,  stop.  [wh;  zh]  »  [qh;0]  is  a  solution.  If  neither 
q  nor  [wh;  zh]  is  nonnegative,  choose  some  wh  <  0  or 
Zg  ■  8 .  Call  ws  the  distinguished  variable  and  zg  the  driving 
variable. 
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Step  2.  Let  0*1  be  the  largest  value  of  z*1  _>  z*1  satisfying  the 

S  "  8 


following  conditions; 

(i)  z*1  <  0  if  z1  *  8 
s  —  s 

/ «  ,  \  h  -h  h  "h 

(il)  ws(z1,...,  z8_1,  z8,  z8+1,  .. 

(iii)  wj(zj,...,  z8l,  z8,  z8+1,  .. 
.  h,-h  -h  h  -h 


,  ih)  <  0  if  wh  <  0 
n  —  s 


,  zh)  >  o  if  w1*  >  0 
n  —  i  — 


/  j  \  h  h  “h  ™li\  .  q  _  *h  y  A 

(iv)  wi(z1 . *8_1»  z8*  zs+1 . 2  6  if  *t  <  0  • 


Step  3.  If  0h  *  »,  i.e.  the  driving  variable  z|j  is  unblocked,  stop. 

No  feasible  solution  exists.  if  0h  .  0,  i.e.  the  driving 

variable  zh  blocks  itself,  then  put  z^+^  ■  0,  z^^  ■  z^ 
s  r  s  i  i 

,  .  ,  ,  -h+1  h h  -h  A  — h  — hs 

for  i  f*  s  and  w  ■  w  (z^,  ...  ,  z^,  0,  zg+1 . z^) . 

Return  to  Step  1  with  h  replaced  by  h+1.  If  0  <  0*1  <  «, 

let  t  be  the  unique  index  determined  by  the  conditions  (ii) , 


(iii)  and  (iv)  of  Step  2. 


Step  4.  If  0  a11**  t  -  s,  pivot  <w8,  Z8>  and  return  to  Step  1 

with  h  replaced  by  h+1. 

If  mj?t  >  0  and  t  ^  s,  pivot  <w^,  z^>  and  return  to  Step  2 
with  h  replaced  by  h+1. 

If  m^t  ■  0,  perform  a  block  pivot  of  order  2  on  the  principal 
submatrix  mJ^,,  where  S  -  (s,t),  and  return  to  Step  2  with  h 
replaced  by  h+1. 

In  this  algorithm,  each  return  to  Step  1  marks  the  completion 
of  a  major  cycle.  Under  the  assumption  of  nondegeneracy,  the  driving 
variable  and  the  distinguished  variable  are  always  Increasing  while  their 
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sum  is  strictly  increasing  [A].  Thus  after  finitely  many  pivots  within  a 
major  cycle,  the  negative  distinguished  variable  Increases  to  zero,  or  else 
it  is  detected  that  the  problem  has  no  feasible  solution.  Furthermore, 
the  end  of  a  major  cycle  reduces  the  number  of  negative  components  in 
(w,z)  by  at  least  one.  Therefore  the  method  is  finite. 

There  is  an  asymmetric  version  of  the  above  method.  It  uses  simple 
pivots  at  each  step  to  exchange  the  blocking  variable  with  the  driving  vari¬ 
able  and  takes  the  complement  of  the  blocking  variable  as  the  new  driving 
variable.  By  a  proof  similar  to  that  of  Theorem  1,  it  can  be  shown  that, 
under  the  same  tie-breaking  rules,  the  two  versions  have  the  same  sequence 
of  exiting  basic  variables  in  a  major  cycle.  (Except  that  when  termination 
of  this  major  cycle  occurs,  the  initial  driving  variable  may  be  the  exiting 
variable  in  the  symmetric  version  while  its  complement  is  exiting  in  the 
symmetric  version.)  Accordingly,  we  work  with  the  symmetric  version  only. 


3.2.  The  least-index  rule 

When  degeneracy  occurs,  the  above  method  may  circle.  In  this 
section  we  show  that  with  the  least-index  rule  of  Section  2,  the  symmetric 
version  of  the  PPM  will  process  (q,M),  where  M  is  positive  semi-definite, 
in  a  finite  number  of  steps.  In  other  words,  it  will  either  find  a  solution 
or  detect  the  Infeasiblllty  of  the  problem.  Again,  it  suffices  to  show 
that  each  major  cycle  is  finite. 

Suppose  circling  occurs  in  a  major  cycle  in  which  w^  is  the 
distinguished  variable.  Then,  as  in  the  case  when  M  is  a  P-matrix, 
since  w^  and  z^  are  monotonlcally  increasing,  both  w^  and  z^  are 
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fixed  during  circling.  However,  the  algorithm  tries  to  increase  z^ 
or  in  this  major  cycle.  Therefore,  as  in  the  case  when  M  is  a 

P-matrlx,  stalling  occurs  in  these  steps.  Accordingly,  if  we  delete  all 
the  variables  that  are  not  involved  in  the  pivoting  during  circling, 
the  PPM  with  the  least-index  rule  merely  looks  for  the  index  i,  where 

i  *  min{  j  I  mj  ^  <  0} 

and  then  the  PPM  pivots  on  (if  +  0)  or  it  pivots  on 

h  h 

“ll  mli 

h  h 

.  ”il  “ii 

Without  loss  of  generality  we  may  assume  that  all  the  variables  are  involved 
in  the  pivoting  during  circling.  Then,  during  circling,  the  PPM  with  the 
least-index  rule  performs  the  same  pivoting  sequence  as  the  following 
scheme  does. 

Scheme 

Step  0.  Start  with  the  system  w*1  -  qh  +  M^z*1,  h  •  0,  where  \P  ■ 
is  the  initial  system.  (In  the  following,  M^  represents 
colunn  of  M*1  corresponding  to  the  nonbaslc  variable  z^ 
iteration  h.  Similarly,  M^.  represents  the  row  of  M*1 
ing  to  the  basic  variable  w^.  ) 


0  u0  0 
q  +  M  z 

the 

at  the 
correspond- 


(if 


m 


ii 


0)  . 
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Step  1.  If  2  °*  stop.  The  driving  variable  z^  can  be  Increased  strictly. 

Otherwise,  let  k  ■  min{i|m^  <  0}. 


Step.  2.  If  >  0»  perform  a  pivot  on 

h  replaced  by  h+1.  Otherwise,  perform  a  block  pivot  of  order  2 
on  the  principal  submatrix 


m^k  and  return  to  Step  1  with 


”11 

"ik 

h 

h 

\l 

"kk 

and  return  to  Step  1  with  h  replaced  by  h+1. 


If  we  can  show  that  2  0  after  a  finite  number  of  pivots  in  the 

above  scheme,  then,  since  the  driving  variable  zj  can  be  Increased  strictly 
at  this  step,  we  obtain  a  contradiction  to  the  assumption  that  circling 
occurs  in  a  major  cycle  (in  which  w^  is  the  distinguished  variable)  of 
the  PPM  with  the  least-index  rule. 

Lemma  4.  In  the  above  scheme,  a  pivot  in  row  k,  where  2  £  k  £  n,  must  be 
followed  by  a  pivot  in  some  row  with  a  larger  index  before  another  pivot 
in  row  k  can  occur. 

Proof.  We  will  prove  this  by  induction.  If  the  matrix  M  is  of  order  1 
or  2,  the  lenma  is  trivial.  Suppose  the  lemma  holds  when  the  order  of  M 
is  less  than  n  and  now  consider  the  case  when  M  is  of  order  n. 

Let  us  examine  the  situation  where  two  pivots  occur  in  row  k 
•“d  ^  £  k  n-1.  If  between  these  two  pivots,  there  is  no  pivot  in  some 
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row  with  a  larger  Index,  then  by  deleting  M>n  and  Mn-,  a  contradiction 
to  the  inductive  hypothesis  will  be  derived.  Therefore,  it  suffices  to 
show  that  there  is  at  most  one  pivot  in  row  n. 

Suppose  a  pivot  occurs  in  row  n  at  iteration  h^.  Let  (Tl)  be 
the  corresponding  schema  at  this  iteration. 


(Tl) 

By  the  choice  of  the  pivot  row,  m..  >  0  for  all  i  <  n-1  and  m  ,  <  0 
in  (Tl).  Note  that  w^ ,  ...  ,  w^  are  the  basic  variables  in  (Tl). 

Suppose  the  next  occurrence  of  a  pivot  in  row  n  is  at  iteration 
h£.  When  this  occurs,  z^  must  be  the  exiting  basic  variable  and  w^ 
is  either  basic  (Case  I)  or  nonbasic  (Case  II). 

Case  I.  is  a  basic  variable  at  iteration 

Let  S  be  the  set  of  indices  i  such  that  w^  is  nonbasic  at 
iteration  hj*  Note  that  1  f  S.  Let  M  denote  the  principal  transform 
of  M  at  this  iteration.  Clearly  M  can  be  obtained  from  M  by  performing 
a  block  pivot  on  the  principal  submatrix  Mgs.  Thus  Mgl  *  “MggHgj 
(since  1  f.  S)  and  therefore 

MS1^S1  "  “MS1MSSMS1  -  0 


since  Mgs  is  positive  semi-definite.  However,  since  m^  >  0, 
m^  2  0  for  all  i  <  n  and  mnl  <  0,  mnl  <  0,  we  have  >  0 

(since  n  £  S) ,  a  contradiction. 

Case  II.  Wj  is  a  nonbaslc  variable  at  iteration  h^. 

We  shall  use  the  same  notation  as  Case  I.  Mote  that  1  £  S  in 
this  case.  Since  M  is  positive  semi-definite,  m^  >0  or  m^  *  0. 

Case  II.  1.  m^  >  0. 

By  performing  a  pivot  on  m^,  becomes  a  basic  variable  and 
the  sign  configuration  of  M. ^  is  unchanged.  In  other  words,  m^j  2  0 
for  all  i  <_  n-1  and  mnl  <  0.  Since  w^  is  a  basic  variable  now,  as 
in  Case  I,  a  contradiction  can  be  derived. 

Case  II. 2.  ra^  =  0  . 

Case  II.2.1.  >  0. 

By  performing  a  pivot  on  m^  in  schema  (Tl) ,  w^  becomes  a  non- 
basic  variable  and  the  sign  configuration  of  M. ^  is  unchanged.  Therefore, 
as  in  Case  I,  a  contradiction  can  be  derived. 
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Case  1 1. 2. 2.  m^  =  0. 

Let  us  denote  the  schema  at  Step  as  (T2) 


(T2) 


where  S  =  {1 . n}  \  S.  Note  that  (T2)  can  be  considered  as  obtained 

from  (Tl)  by  performing  a  block,  pivot  on  the  principal  submatrix  Mc  . 

(Recall  that  1  €  S  in  this  case.) 

If  we  enlarge  the  schema  (Tl)  to  (Tl*)  by  adding  one  row  and  one 
column  such  that  Mr+1  =  (1,  0,  ...  ,0,  1)  and  M  n+1  =  (-1,  0,  ...  ,0,  1)T 
and  an  arbitrary  number,  the  enlarged  matrix  of  order  n+1  is  still 

positive  semidefinite. 


(Tl*) 


By  performing  a  block  pivot  on  the  principal  submatrix  MgS  in  (Tl*) , 
a  schema  (T2*)  is  obtained  which  has  the  same  entries  q^,  m^  as  the  schema 
(T2)  for  all  i,  j  £  n. 
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(T2*) 


Also,  (T2*)  has  the  same  basic  variables  as  (T2)  does.  Therefore  (T2*) 
is  also  an  enlargement  of  the  schema  (T2) .  By  pivotal  algebra 

miH-l,l  “  Mn+l,S  ’  ^S1 

-  (1,0 . 0)  •  Mgl 

"“11 

-  0  . 

Furthermore,  by  performing  a  block  pivot  on  the  principal  submatrix 

mll  “l,n+l 

mn+l , 1  mn+l , n+1 

the  schema  (Tl*)  becomes  the  following  schema  (T2**)  in  which  w^  and 

w  , ,  are  nonbaslc  while  all  other  w . ' s  are  still  basic . 
n+1  i 
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(T2**) 


1 

wi 

z2 

z 

n 

V 

n+1 

Z1 

a 

a 

’i 

i 

l 

i 

I 

l 

sii 

J12 

*  *  « 

m. 

In 

= 

TD 

l,n+l 

W2 

= 

;2 

l 

I 

I 

\ 

l 

”21 

”22 

*  *  * 

“2n 

m 

2,  n+1 

w  = 

n 

% 

\  m  , 
i  nl 

mn2 

m 

nn 

2  n+1  = 

Vi 

i 

j  n+1,1 

mn+l,2 

...  m 

n+l,n 

Since  *  0, 

>  0 

for  all  2 

£  i  <  n. 

m  ,  <  0  and 
nl 

kJ  xui.  c  ui,  i  •  in,-.  s  vs  i-  vi  axx  x  \  a  \  u>  lu  ,  \  u  auu  ui  ,  ,  ,  —  x  * 

11  il  —  —  nl  n+1,1 

m  s  z 

It  can  easily  be  seen  that  m  ,  =  1,  m  -  >  0  for  all  2  <  i  <  n,  m  ,  <0 

II  it  nl 

and  m  , ,  ,  *  -1 
n+1,1 

Now  since  both  (T2*)  and  (T2**)  are  principal  transforms  of  the 
schema  (Tl*),  (T2**)  is  a  principal  transform  of  (T2*) .  In  fact,  if 
we  denote  R  =  (S\{1})  U  {n+1},  then  (T2**)  can  be  obtained  by  performing 
a  block  pivot  on  the  principal  submatrix  in  (T2*) .  Therefore 

\i  -  '  «“>  sl“«  18  "°8lt1''8 

semi-definite,  — £  0-  However,  since  n  €  R,  n+1  €  R  and 

m  ,  <  0,  m  ,  =  0,  m  ,  <  0,  m  ,  -  -1  while  for  other  i  e  R,  m, ,  >  0, 

nl  n+1,1  nl  n+1,1  il 

mA1  0;  therefore  >  0,  a  contradiction,  a 


Lemma  5.  In  the  above  schema,  M.^  0  after  a  finite  number  of  iterations. 

Proof.  For  j  >  1,  let  v(j)  be  the  number  of  pivots  that  occur  in 
row  j.  In  the  proof  of  Lemma  4,  we  have  shown  that  v(n)  1. 

Furthermore,  it  follows  from  Lemma  4  that 
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In  other  words 


n 

v(j)  <  I  v(i)  +  1  . 
i=j+l 

v(n-l)  <  v(n)  +  1  <  2 
v(n-2)  <_  22 

v(n-i)  <  21-1  +  21-2  +...+2+2°+l=2i  . 

Therefore,  the  above  scheme  will  terminate  after  a  finite  number  of 
iterations.  a 

Theorem  3.  In  the  positive  semi-definite  case,  every  major  cycle  of  the 
PPM  with  least-index  rule  consists  of  a  finite  number  of  pivots. 

Proof .  Suppose  circling  occurs  in  a  major  cycle  in  which  w^  is  the  dis¬ 
tinguished  variable.  Then,  as  in  the  case  when  M  is  a  P-matrix,  since 
w^  and  z ^  are  monotonically  increasing,  both  w^  and  z^  are  fixed 

during  circling.  However,  it  follows  from  Lenina  5  that  M.^  0  after 

a  finite  number  of  steps.  Therefore  either  w^  or  z ^  can  be  strictly 
Increased  after  a  finite  number  of  steps,  in  contradiction  to  the  assumption 
that  circling  occurs.  □ 

Corollary.  In  the  positive  seml-deflnlte  case,  the  PPM  with  least-index 
rule  will  process  the  problem  in  a  finite  number  of  steps. 
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Proof .  Since  each  major  cycle  reduces  the  number  of  negative  components 
in  (w,z)  by  at  least  one,  the  result  follows  from  Theorem  3.  □ 


Remark  1.  As  in  the  case  when  M  is  a  P-matrix,  Lemma  4  implies  that  if 
stalling  occurs  in  the  PPM  with  least-index  rule  for  (q,M)  where  M  is 
positive  semi-definite,  then  during  stalling,  a  pivot  in  row  k  (except 
the  row  corresponding  to  the  distinguished  variable)  must  be  followed  by 
a  pivot  in  some  row  with  a  larger  index  before  another  pivot  in  row  k  can 
occur . 


Remark  2.  The  least-index  rule  states  that  if  the  distinguished  variable 
is  blocking,  then  it  is  chosen  as  the  exiting  basic  variable  even  if  there 
is  a  blocking  basic  variable  with  a  smaller  index.  This  is  essential  in 
the  interpretation  of  the  rule.  The  following  is  an  example  which  has  a 
solution,  but  if  the  least-index  rule  is  incorrectly  applied,  the  driving 
variable  will  be  unblocked  and  hence  give  the  false  impression  that  the 
problem  is  infeasible. 


Example.  Consider 


(q,M)  where 


M  - 


q  *  (1.  -1. 

1  -1  0  ' 
-110 
0  0  1 


and 


Clearly,  M  is  positive-semi-definite  and  (w;z)  “  (0,  0,  0;  0,  1,  1) 
is  a  solution.  Consider  the  major  cycle  in  which  W2  is  the  distinguished 
variable. 
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1  Z, 


When  the  driving  variable  z ^  increases  to  1,  both  and  are 

blocking.  If  our  least-index  rule  is  imposed,  then  the  pivot  ^w2,z2’> 
is  performed  since  is  the  distinguished  variable.  However,  if  the 

least-index  rule  is  incorrectly  applied,  is  chosen  as  the  exiting 
basic  variable,  and  then  the  pivot  <w^,z^>  is  performed. 


*1  z2  t 


Now,  since  w^  is  still  the  distinguished  variable,  the  driving  vari¬ 
able  is  still  z 2  and  its  column  is  nonnegative,  hence  z ^  la  unblocked. 
Therefore,  according  to  Step  3  of  the  statement  of  the  PPM  in  Section  3.1, 
one  gets  the  mistaken  impression  that  the  problem  is  infeasible. 


A.  Circling  examples  of  minimal  dimension. 

In  this  section,  we  give  a  circling  example  for  the  PPM  on  (q,M) 
where  M  is  a  positive  definite  matrix  of  order  four  (hence  M  is  a 
P-matrlx  as  well  as  a  positive  semi-definite  matrix).  We  will  also  show 
that  four  is  the  sharp  lower  bound  on  the  order  of  M  for  the  circling 
to  occur. 
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Example  1.  Consider  the  initial  schema  in  which  w.^  is  the  distinguished 
variable 


1 

21 

z2 

Z3 

Z4 

W1  " 

-1 

1 

-0.3 

-92108 

173608 

w2  " 

0 

0.3 

0.00001 

0.5 

-2 

w3  " 

0 

92108 

-0.5 

23840 

-44932 

W4  “ 

0 

-173608 

2 

-44932 

84688 

BiJ  “ji 


all  i  +  j 

except  for  i 

=  J 

m33 

m34  ' 

T  23840 

-44932 

•  m43 

m44  - 

|_  -44932 

84688 

is  positive  definite,  M  is  positive  definite.  After  the  six  pivots 
<w4,z4>,  <w3,z3>,  <w2,z2>,  <z4,w 4>,  <z3,w3>  and  <z2,w2>,  one  returns 
to  the  initial  schema. 

Example  1  is  a  circling  example  in  which  M  is  of  order  four . 
Next  we  show  that,  in  fact,  four  is  the  least  dimension  in  which  circling 
can  occur. 

Theorem  4.  For  circling  to  occur  in  the  PPM  applied  to  (q>M)  where 
M  is  either  a  P-matrix  or  a  positive  semi-definite  matrix,  the  order  of 
M  must  be  at  least  four. 
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Proof .  Without  loss  of  generality,  we  can  assume  that  is  the  dis- 

tinghished  variable  of  the  major  cycle  in  which  circling  occurs.  Let 
K  =  ti|i  ^  1,  w^  becomes  nonbasic  during  circling}.  In  Section  2  and 
Section  3  it  has  been  shown  that,  during  circling,  the  algorithm  merely 
chooses  some  k  €  K  such  that  m^  <  0  and  then  pivots  on  m^  (if 
m^k  >  0)  or  on 


mll  “lk 


mkl  \k  Uf  I"kk 


If  the  order  of  M  is  less  than  four,  then  since  1  i  K,  the  cardinality 
of  K  is  at  most  two.  Since  m^,  t'le  Pivotai  transform  of  m^,  is 
positive,  m  ^  <  0  for  at  most  one  i  €  K  during  circling.  Thus  by  default 
this  negative  m^  has  the  smallest  index  among  all  m^  <  0  where  j  €  K. 
It  follows  that  the  least-index  rule  is  implicitly  imposed  thereby  making 
circling  impossible,  and  the  theorem  follows.  □ 
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PART  II 


LEAST-INDEX  RESOLUTION  OF  DEGENERACY  IN 
LEMKE 'S  ALGORITHM  AND  COTTLE’S  ALGORITHM 


1.  Introduction. 

Another,  more  robust,  method  for  the  LCP  is  due  to  Lemke  [12], 

[14].  Since  Lemke’s  algorithm  is  also  a  pivotal  method,  it  is  not  surprising 
that  it  may  circle  when  degeneracy  occurs.  Some  circling  examples  will  be 
given  later. 

In  this  Part,  we  impost  a  least-index  rule  on  Lemke' s  algorithm 
and  prove  its  finiteness  when  the  matrix  is  either  a  P-matrix  or  a  positive 
semi-def inlte  matrix.  We  also  show  that  Cottle's  algorithm  [3]  for  the 
parametric  LCP  is  finite  when  the  least-index  rule  is  imposed. 


2.  Lemke' s  algorithm  for  (q,M). 

2.1.  A  brief  review  of  the  algorithm. 

Consider  the  auxiliary  LCP 

(1)  w  ■  q  +  zQe  +  Mz 

(2)  (w,  z,  zQ)  >  0 

(3)  wTz  ■  0 
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where  e  (  e  >  0  and  z^  is  an  artificial  variable.  A  solution  of 

this  system  with  =  0  is  necessarily  a  solution  of  (q,M) .  If  e^  >  0 
for  all  i  such  that  q.^  0,  then  for  z  =  0  and  zQ  suitably  large, 

w  >  0,  and  (2),  (3)  hold.  Lemke's  algorithm  starts  with  such  a  z  and 
Zq  and  performs  a  sequence  of  pivots  to  achieve  the  condition  z^  =  0. 
Once  Zq  =  0,  a  solution  to  (q,M)  is  obtained  since  during  the  process, 
(2)  and  (3)  are  always  preserved. 


Lemke’s  algorithm. 

Step  0.  Start  with  the  basic  solution  (w;Zq?z)  *  (q;0;0)  and  the 
matrix  M  *  [e,M] . 

Step  1.  If  q  >  0,  stop.  A  solution  (w;z)  =  (q;0)  is  obtained. 

Otherwise,  define  k  by  =  niax^{-  q^/e^}  and  then 

pivot  <w^,Zq>.  Let  (q,  M)  denote  the  updated  tableau  and 
designate  z^,  the  complement  of  w^,  as  the  driving  variable. 

Step  2.  If  the  driving  variable  z^  is  unblocked,  stop.  Otherwise 


define  j  by 


-Vv  “  mln{"5i/"ik|”ik <  0}  • 


Step  3.  If  Zq  is  the  blocking  variable,  stop.  A  solution  is  at  hand. 

Otherwise,  perform  the  pivot  <Wj,Zjc>  and  let  z j ,  the  comple¬ 
ment  of  Wj ,  be  the  new  driving  variable.  Return  to  Step  2  with 
the  updated  tableau. 


In  the  nondegenerate  case,  Lemke's  algorithm  is  finite  [5],  [12]. 
If  z^  is  unblocked  in  Step  2,  we  say  that  the  algorithm  terminates  on 
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a  secondary  ray.  When  this  happens,  some  results  can  be  derived  from  the 
following  theorem  which  Is  proved  In  [5]. 

Theorem  1.  If  Lemke's  algorithm  applied  to  (q,M)  terminates  on  a  ray, 
there  exists  a  nonzero,  nonnegative  vector  u  such  that 

(4)  ui(Mu)i  <  0  for  i  -  1,2,...,  n. 

In  the  case  when  M  is  a  P-matrix,  (4)  cannot  have  a  nonzero  solu¬ 
tion  and  consequently  Lemke's  algorithm  will  solve  this  problem.  When  M 
is  positive  seml-deflnlte  or,  more  generally,  copositive-plus,  termina¬ 
tion  on  a  ray  implies  that  (q,M)  is  infeasible  [12].  It  is  also  well 
known  that  Lemke's  algorithm  can  be  applied  to  other  classes  of  linear  com¬ 
plementarity  problems.  Some  detailed  discussions  can  be  found  in  [8], 

[9],  and  [13]. 

As  mentioned  above,  Lemke's  algorithm  may  circle  when  degeneracy 
occurs.  Let  us  define  the  length  of  a  circle  to  be  the  number  of  distinct 
basic  sets  in  this  circle.  Kostreva  [11]  has  shown  that  the  minimum  length 
of  a  circle  in  Lemke's  algorithm  for  a  general  (q,M)  is  four.  Moreover, 
he  gives  an  example  to  illustrate  that  circling  can  occur  when  M  is 
of  order  two. 

Kosteva's  circling  example  of  order  two.  Example  2  of  [11],  uses 
an  uncommon  artifical  vector  e.  Usually,  e  should  be  nonnegative  (in 
order  to  initiate  the  process  from  a  ray).  If  we  always  let  the  artificial 
vector  e  be  nonnegative,  his  proof  can  still  be  applied  to  show  that 
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the  minimum  length  of  a  circle  is  four.  But  we  will  show  that  for  circling 
to  occur,  M  must  be  of  order  at  least  three.  From  the  following  example, 
it  can  be  seen  that  Kostreva's  bound  on  the  length  of  circling  is  sharp. 


Example  1.  Apply  Lemke's  algorithm  to  (q,M)  where 


'  o" 

‘  -1  -1  1  ■ 

q  = 

-2 

M  = 

110 

_-3_ 

!  11. 

T 

Since  =  0  and  q 2  <  0,  q3  <  0,  we  let  e  =  (0,1,1)  .  The 
schema  is 


After  the  pivots  <w3>Zq>,  we  have  the  schema 


(*) 


After  further  pivots  <w^,Z2>,  ^zl,w2^  and  ^w2,wi^' 

to  (*)  and  a  circle  of  length  four  is  obtained. 
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initial 


we  return 


f 


l 


* 


Next  we  show  that  the  matrix  M  in  Example  1  has  the  least  possible 
order  for  circling  to  occur. 

Proposition.  If  M  is  of  order  two,  Lemke's  algorithm  applied  to  (q,M) 
will  terminate  in  a  finite  number  of  pivots  for  any  q. 

Proof •  If  q  >  0,  there  is  nothing  to  prove.  Hence  assume  that  qj  <  0. 
Let  (e1,e2)  =  (l,e2)T  where  e2  >  0  (e2  >0  if  q2  <  0) . 


Without  loss  of  generality,  we  can  assume  that  w^  blocks  z^  when  z^ 
decreases  to  -q^.  Then  the  pivot  <w^,Zq>  is  performed.  After  the  pivot, 


Now  is  the  new  driving  variable.  If  zQ  blocks  z  ,  terminate. 

Otherwise,  w2  blocks  z^  and  the  pivot  <w2»z^>  is  performed.  After 
the  pivot,  e2  0  and  a2  is  the  new  driving  variable. 
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1 


If  Zq  blocks  z^,  terminate.  Otherwise,  z^  is  blocking  and 
the  pivot  <z^,Z2>  is  performed. 


1 

W1 

CM 

* 

Z1 

z0  =  *1 

h 

\l 

ft12 

Z2  =  «2 

62 

“21 

fi22 

Now  w^  is  the  next  driving  variable.  However,  0.  Hence  w^  is 

either  blocked  by  Zq  and  a  solution  is  obtained,  or  else  w^  is  un¬ 
blocked  and  the  algorithm  terminates  on  a  ray.  □ 


Lemke's  algorithm  with  the  least-index  rule. 


Even  when  M  is  a  P-matrix,  Lemke's  algorithm  applied  to  (q,M) 
may  circle;  e.g.,  see  Example  1  of  [11].  However,  we  show  in  this  section 
that  when  M  is  a  P-matrix  or  a  positive  semi-definite  matrix,  Lemke's 
algorithm  with  the  least-index  rule  will  process  (q,M)  in  a  finite  number 
of  steps.  We  say  that  the  least-index  rule  is  imposed  in  Lemke's  algorithm 


3' 


if,  when  there  is  a  tie  in  choosing  the  exiting  basic  variable,  we  always 
choose  the  one  with  the  least  index  as  the  exiting  basic  variable.  Note 
that  the  index  of  the  artificial  variable  z^  is  less  than  all  other 
indices,  hence  it  will  be  chosen  if  it  is  involved  in  a  tie. 


Theorem  2.  When  M  is  a  P-matrix  or  a  positive  semi-definite  matrix, 
Lemke's  algorithm  with  the  least-index  rule  will  process  (q,M)  in  a 
finite  number  of  steps. 


Proof.  It  is  clear  that  when  M  is  positive  semi-definite,  then  so  is 
the  matrix  m  where 


M 


T 

e 

M 


for  some  real  number  y  >_  0.  It  is  also  clear  that  when  M  is  a  P-matrix, 
then  so  is  the  matrix  M  if  y  is  suitably  large. 

Lemke's  algorithm  starts  with  the  system  (1)  where  z  =  0  and  z^ 
large  enough  so  that  w  0,  and  then  performs  a  sequence  of  pivots  to 
achieve  the  condition  z^  *  0  (or  else  it  goes  off  on  a  ray).  Let  z^  >  0 
be  the  smallest  value  of  z^  such  that  q  q  +  z^e  0.  We  can  rewrite 
(1)  as  follows: 


where 


w  -  q  +  zQe  +  Mz 
■  q  +  a(-e)  +  Mz 


a 


z 


0 
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Note  that  q  ^  0  and  a  increases  from  0  at  the  first  step  of  Lemke's 
algorithm.  Furthermore,  Zq  *  0  if  and  only  if  a  =  Zq* 

Therefore,  by  denoting 


y 


and 


T 

e 

M 


where  p  is  sufficiently  large  and  <  0  such  that  the  absolute  value 
of  q^  is  sufficiently  larger  than  p,  Lemke's  algorithm  on  (q,M)  .an 
be  regarded  as  a  major  cycle  of  the  principal  pivoting  method  on  (yji) 
in  which  a  is  the  initial  driving  variable  (a  can  be  regarded  as  having 
the  same  index  as  Zq  does,  namely  0). 


1 

a  z 

T 

w  = 

0 

qo 

p  e 

w  * 

q 

-e  M 

Since  Zq  *  0  whenever  a  *  Zq,  in  addition  to  the  termination 
rules  for  the  principal  pivoting  method,  we  terminate  this  major  cycle 
when  a  ■  Zq  and  in  this  case,  a  solution  to  (q,M)  is  obtained.  However, 
it  has  been  shown  in  Part  I  that  each  major  cycle  of  the  PPM  with  the 
least-index  rule  is  finite,  thus  the  result  follows.  □ 

Remark  1.  From  the  above  proof,  it  can  also  be  seen  that  in  Lemke's 
algorithm,  the  artificial  variable  Zq  Is  always  monotonically  decreasing 
when  M  is  a  P-matrix  or  a  positive  semi-definite  matrix,  Cottle  [2], 
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Remark  2.  Since  the  self-dual  method  [6]  for  linear  programming  is  a 
special  case  of  Lemke’s  algorithm,  the  least-index  rule  can  be  applied 
there  also. 

Corollary.  The  minimum  length  of  a  circle  in  the  Lemke's  algorithm  without 
the  least  index  rule  applied  to  (q,M),  where  M  is  a  ?-matrix  or  a  positive 
semi-definite  matrix,  is  six.  Furthermore,  the  bound  is  sharp. 

Proof.  The  above  proof  shows  that  Lemke's  algorithm  can  be  regarded  as 
part  of  a  major  cycle  of  PPM.  Thus  it  follows  from  Theorem  4  of  Part  I 
that  the  minimum  length  of  a  circle  is  larger  than  or  equal  to  six. 

Example  1  of  Kostreva  [11]  illustrates  that  six  is  the  sharp 
bound  for  the  P-matrix  case.  In  the  case  of  positive  semi-definite  matrix, 
let  M  be  obtained  from  Example  1  of  Part  I  by  performing  a  pivot  on  “33. 
then  5^  <  0  for  i  *  2,3,4.  Thus  by  considering  e  *  ~^21'  ^31*  ^41^’ 
Example  1  of  Part  I  and  the  proof  for  the  above  theorem  show  that  the 
bound  is  sharp. 


Theorem  2  shows  that,  when  M  is  a  P-matrix  or  a  positive  semi- 
definite  matrix,  Lemke's  algorithm  with  the  least-index  rule  will  process 
the  problem  in  a  finite  number  of  steps.  Unfortunately,  this  is  not 


below  illustrates  this. 


Example  2.  Consider  the  LCP  (q,M)  where 


Clearly  M  is  strictly  copositive,  and  hence  copositive  -  plus.  Start¬ 
ing  with  the  schema 


1 

Z0  Z1  Z2  Z3  Z4 

W1 = 

-10 

1  i  2  3  3  2 

1 

W2  = 

-10 

1  i  2  2  2  3 

1 

W3  = 

-10 

1 

1  !  2  3  3  1 

1 

w4  = 

-8 

ljl  1  1  2 

Lemke's  algorithm  with  the  least-index  rule  generates  the  pivoting  sequence 
<wl,z0>,  <w4,Zl>,  <w3,Z4>  and  obtains  the  schema 


(**) 


After  the  further  pivots  <W2*z3>,  <z3,z2>,  schema  (**)  becomes 


38 


1 


W1  w4  Z3  W2  W3  t 


z0  ‘ 
z2  “ 

(***) 

z4  * 
Z1  " 


If  the  least- index  rule  is  applied,  then,  after  two  more  pivots  <Z2 *w2> • 
<W3,W2^,  sc^ema  (**)  reappears  and  thus  circling  occurs. 

However,  if  (instead  of  <w^,w2>)  the  pivot  <z^,w^>  is 

performed  in  (***),  then  after  the  further  pivots  <z^,w^>,  <w^,w^>,  <w^,z^>, 
<z2,z^>  and  <Zq,w2>,  a  solution 


w 


,14  16 

'  5  *  5 


0,  0), 


z  *  (0,  0, 


12  14 

5  »  5  } 


is  obtained. 

In  this  circling  example,  the  artificial  variable  z^  remains 
constant  during  circling.  This  is  not  true  in  general.  For  example,  if 
*  -10  is  replaced  by  q^  *  -9.5  in  Example  2,  then  Lemke's  algorithm 
with  the  least-index  rule  generates  the  same  circling  sequence  as  above. 
However,  during  circling,  the  artificial  variable  z^  no  longer  remains 
constant.  The  reason  why  the  least-index  rule  works  in  P-matrix  and 
positive  seml-deflnlte  matrix  cases  but  not  in  general  remains  to  be  found. 
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3.  Cottle' 8  algorithm  for  the  parametric  LCP. 


By  applying  Grave's  lexicographic  principal  pivoting  method  [10] 
for  LCP,  Cottle  [3]  developed  a  finite  algorithm  for  checking  the  mono¬ 
tonicity  of  the  solutions  to  the  parametric  LCP  {(q  +  ap,M)|ot  _>  0,  q  ^  0} 
in  which  M  is  a  P-matrix  or  a  positive  semi-definite  matrix.  If  the 
monotonicity  check  is  deropped  in  this  algorithm,  we  obtain  an  algorithm 
for  solving  the  PLCP  which  we  call  Cottle's  algorithm  for  PLCP.  Without 
taking  some  (lexicographic)  precautions  for  the  constant  column  of  [3], 
Cottle's  algorithm  may  circle.  For  example,  if  q^  *  -1  is  replaced  by 
q^  »  1  in  Example  1  of  Part  I  and  p  -  (1,  0.3,  92108,  -173608)T,  then 
circling  occurs.  However,  we  shall  show  here  that  Cottle's  algorithm 
with  the  least-index  rule  is  finite. 

3.1.  A  brief  review  of  the  method. 

Consider  a  PLCP  {(q  +  ap,M)lq  >.  0,a  0}  where  M  is  either 

a  P-matrix  or  a  positive  semi-definite  matrix.  Let  Q  be  a  matrix  having 
linearly  independent  lexicographically  positive  rows  and  q  as  its  first 
column  (q  +  0).  The  lexicography  is  used  as  a  cure  for  the  degeneracy 
problem,  not  as  a  means  to  achieve  greater  generality. 

Statement  of  Cottle's  algorithm  for  PLCP 

Step  0.  Initialization.  Start  with  o  at  the  "critical  value"  a  •  0 
and  set  z  ■  0. 

Step  1.  If  p  2  0>  stop.  (w;z)  ■  (q  +  ap;0)  is  a  solution  for  all 
a  >  0.  Otherwise 


Step  2.  Determine  the  critical  index  r  by  the  condition 


-Qr/Pr  ■  lexico  mint-Q^/P^IP^  <  0).  Set  a  equal  to  the 

new  critical  value  a  *  q  /-p  . 

r  r 

Step  3.  Change  of  basis. 

Case_l.  >  0,  then  pivot  on  m^r  and  return  to  Step  1  with  transformed 

tableau . 

Case  2.  m  ■  0. 

-  rr 

If  M>r  0,  stop.  The  problem  is  infeasible  for  all  a  >  a. 
Otherwise,  define  the  index  s  by 

"(Qs  "  QrVPr)/msr  "  lexlco  “  Vi/Pr)/mir  |mir  <  0} 

and  pivot  on 

m  m 
rr  rs 

m  _  m 
sr  ss 

Return  to  Step  1  with  the  transformed  tableau. 

It  can  be  shown  that  this  algorithm  is  finite  [3],  [10].  This 
algorithm  is  also  closely  related  to  the  Dantzlg-Cottle  principal  pivoting 
method.  In  fact,  we  have  the  following: 

Theorem  3.  Suppose  that  M  is  a  P-matrix  or  a  posiclve  semi-definite 
matrix.  Let  u  >  0  be  large  enough  such  that 


(Tl*) 


1  a 


t  *1 


z 

8 


V, 


If  p  >  0,  then  both  PPM  and  Cottle's  PLCP  algorithm  terminate  at  this  step. 
Therefore,  assume  p  £  0. 

Suppose  that  r  Is  the  critical  Index  in  (Tl*)  and  the  critical 
value  at  this  step  is  o  -  qr/-pr  .  Clearly  wr  is  also  a  blocking 
variable  in  (Tl)  when  z^  increases  to  q^-p^. 

If  mrr  >  0,  both  PPM  and  Cottle's  PLCP  algorithm  pivot  on  ®rr* 
After  the  pivot,  the  basic  variables  of  PPM  are  identical  to  the  basic  vari¬ 
ables  of  Cottle's  PLCP  algorithm  except  that  PPM  still  has  one  more  basic 
variable  w^.  Furthermore,  the  common  basic  variables  have  the  same  values 
at  this  step,  and  the  driving  columns  are  still  the  same.  It  follows  that 
the  next  blocking  variables  in  these  two  algorithms  will  be  identical. 

Now  suppose  mfr  ■  0.  The  PPM  performs  a  block  pivot  of  order  2 
on  the  principal  suboatrlx 
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* 


i  a 


Note  that  (6)  Implies  that  in  (Tl),  (Tl*),  when 

*0  “  a  "  V'p r  • 

*r  "  ’<*.  -  V./pr)/-.r  • 

and 

z4  ■  0  ,  for  all  i  ^  r,  0  , 

5 


we  have 


It  can  also  be  easily  checked  that  w  ,>  0  at  this  step.  Therefore,  wg 
Is  a  blocking  variable  in  (T2) .  In  schema  (T2),  we  have 


It  follows  from  (6)  that  m  t  0  and  hence  m  >0.  Therefore,  the 

sr  ss 

PPM  performs  a  pivot  on  msg,  and  after  the  pivot  (T2)  becomes 
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3.2.  Cottle's  PLCP  algorithm  with  the  least-index  rule. 


In  this  section,  we  shall  give  a  modification  of  Cottle's  algorithm 
and  prove  its  finiteness  without  recourse  to  a  lexicopositive  matrix  Q. 

To  accomplish  this,  we  introduce  a  refinement  of  Cottle's  algorithm  which 
imposes  the  following  least-index  rule: 

(i)  In  Step  2,  determine  the  critical  index  r  by 

r  =  min(k|pk  <  0,  ~qk/Pk  =  min(-qi/p1lpi  <  0}} 
k 

(ii)  In  the  Case  2  of  Step  3,  define  s  by 

s  =  min{k|mkr  <  0,  -(qk  ~  qrpk/pr)/mkr  *  m±n “  qipi/pr)/mir  lmir  < 


In  (i)  and  (ii),  M.^  represents  the  column  of  M  corresponding  to  the 
current  nonbasic  variable  z^.  Similarly,  (q^,  p^,  )  represents  the 

row  of  the  schema  corresponding  to  the  current  basic  variable  w^. 


Theorem  4.  Cottle's  PLCP  algorithm  with  the  least-index  rule  will 
terminate  in  a  finite  number  of  steps. 

Proof .  Theorem  3  shows  that  the  execution  of  Cottle's  PLCP  algorithm  is 
just  a  major  cycle  of  the  Dantzig-Cottle  PPM.  Therefore,  the  result 
follows  from  Theorem  2  and  Theorem  3  of  Part  1.  D 
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An  extension  of  Murty's  scheme  for  (q,M). 

Murty's  scheme  [15]  can  be  applied  to  (q,M)  only  when  M  is 
a  P-matrix.  In  this  section  we  give  an  extension  of  Murty's  scheme  to 
solve  (q,M)  In  which  M  is  a  positive  semi-definite  matrix.  In  the 
following,  M  is  either  a  P-matrix  or  a  positive  semi-definite  matrix. 


Statement  of  a  direct  scheme  for  (q,M) 

Step  0.  Set  h  ■  0.  Begin  with  the  system  w*1  =  q*1  +  M^z*1  where 

w°  ■  q®  +  M^z®  is  the  given  system  w  -  q  +  Mz.  The  nonbasic 
vector  z*1  always  assumes  value  0. 

t.  U  U  L 

Step  1.  If  qn  2  0,  stop.  [w  ;zn]  »  [q  ;0]  is  a  solution.  Otherwise, 
choose  y  *  min{i|w^  <  0). 

Step  2.  Change  of  basis. 

Case  1.  m*1  >0,  then  pivot  on  m*1  .  Set  h  ■  h+1  and  return 

rr  r  rr 

to  Step  1. 

Case  2.  m^  “0. 
rr 

If  2.  0»  stop.  The  problem  is  infeasible. 

Otherwise,  choose 

s  *  min{i|m^r  <  0} 
and  pivot  on 


m. 


rr 


m 


sr 


Set  h  ■  h+1  and  return  to  Step  1. 
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Theorem  5.  When  M  is  either  a  P-matrix  or  a  positive  semi-definite 


matrix,  the  above  scheme  will  process  (q,M)  in  a  finite  number  of 
pivots. 

Proof.  The  above  scheme  generates  the  same  pivoting  sequence  as  that 
generated  by  Cottle's  algorithm  with  the  least-index  rule  for  the  PLCP 
{(0  +  aq,M)|ct  0)  where  0  is  a  zero  vector.  Therefore,  the  result  follows 
from  Theorem  4.  □ 
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